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Abstract 

We formulate the large deviations for a class of two scale chemical ki¬ 
netic processes motivated from biological applications. The result is suc¬ 
cessfully applied to treat a genetic switching model with positive feed¬ 
backs. The corresponding Hamiltonian is convex with respect to the mo¬ 
mentum variable as a by-product of the large deviation theory. This prop¬ 
erty ensures its superiority in the rare event simulations compared with 
the result obtained by formal WKB asymptotics. The result is of general 
interest to understand the large deviations for multiscale problems. 

1. Introduction 

We will investigate the large deviations for a class of two scale chemical 
kinetic processes with the slow variable z n eN d In satisfying 

z„(t) = z„(0) + ^2p / | w J Xi{z n {s),£, n {s))ds^Ui (1.1) 

subject to some fixed initial state z n { 0) = z°, where {-P;(f)};=i. s are in¬ 

dependent uni-rate Poisson processes, A; e U + is called the propensity 
function which characterizes the reaction rate of the zth reaction and 
Ui £ I d is called the state change vector. The number n £ l\l corresponds 
to the system volume, thus z n has the meaning of concentration (num¬ 
ber of molecules per volume) for the considered kinetic system. The fast 
variable £ Zd := {1,2,••• ,D } is a simple jump process with the time 
dependent rate nqij{z n {t )) from state i to j at time t. With this math¬ 
ematical setup, the processes z n (t) and <fy(t) are fully coupled to each 
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other and the infinitesimal generator 5£ n of this system has the form 

s 

5£ n h[z, i) =nY^ Ai(z, i)[h{z+ ui/n, i ) - h{z, /)] 

l=i 

D 

+ nj^ qij(.z)[h(.z,j)-h{z,i)], (1.2) 

;'=i 
jfr 

where z e N d In , i e Zd and h is any compactly supported smooth func¬ 
tion of z for each i. For more about the notations and the backgrounds 
on the chemical kinetic processes, the readers may be referred to (HI T3l . 

The above problem is motivated by our recent rare event study in the 
biological applications (DC® ED. I n a cell, the reactions underlying gene 
expression usually involve low copy number of molecules, such as DNA, 
mRNAs and transcription factors, so the stochasticity in gene regulation 
process is inevitable even under constant environmental conditions |T0l. 
When the number of the molecules for all species goes to infinity and 
the law of mass action holds for the propensity functions, one gets the 
well-known large volume limit or Kurtz’s limit, which gives the determin¬ 
istic reaction rate equations for the concentration of the species Q7] . The 
convergence result can be further refined to the large deviation type ESI. 
Recently, the following typical biological model with positive feedbacks 
is utilized to investigate the robustness of the genetic switching system 

m HUS ED. 

DNAin 0 0 

g(z 2 )1 |fcz 2 ) } y | 1 

a jb 

DNAact -> mRNA (Zi) -> Protein (Z 2 ) 

This problem is a special case of our formulation shown at the beginning 
of this paper for d = 2, D - 2 and S = 4. Denote n the system size and 
z = (z 1; z 2 ) = (Z], Z 2 )l n the slow variables after taking large volume scal¬ 
ing, where Z\ and Z 2 are the number of mRNA and protein molecules, re¬ 
spectively. Since there is only one molecule of DNA at active (DNA act ) or 
inactive state (DNA in ), for better use of notation, we take the fast variable 
£ g {0,1} instead of {1,2} to represent that the DNA is at inactive (£ = 0) 
or active state (£ = 1), respectively. By taking into account the scaling of 
parameters 

a ~ nb~ l , F(Z 2 ),G(Z 2 ) ~ O(n) if Zi,Z 2 ~0(rc), 
we further assume 


F{Z 2 ) = nf{z 2 ), G[Z 2 ) = ng{z 2 ). 


( 1 . 3 ) 
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This assumption holds when we consider a Hill-function type jump rates 
with Hill coefficient 2 and large volume scaling for equilibrium constants 
ffl . Thus, we have the rescaled jump rates for DNA 

qoi(z) = /(z 2 ), qwiz) = g(z 2 ), (1.4) 

and the following list of reactions associated with slow variables as shown 
in Table [1] 


Table 1. Reaction schemes and parameters 


Reaction scheme 

Propensity function 

State change vector 

DNA act —<► mRNA 

Ai(zi,z 2 ,<f) = 

Mi = (1,0) 

mRNA —<• 0 

A 2 (z 1 ,z 2 ,0 = r z i 

u 2 = (-1,0) 

mRNA — Protein 

A 3 (zi,z 2 ,(f) = jbzi 

m 3 = (0,1) 

Protein — 0 

3-4 (zi, z 2 , <!;) = z 2 

m 4 = (0,-1) 


The infinitesimal generator of this process has the form 

5£ n h{z, i) = nJ^Ai(z, i)\h{z+ n~ l ui, i ) - Hz, z) 
z=i v 

+ n(/(z 2 ) [Hz, l) - h{z, 0)] + g(z 2 ) [Hz, 0) - h[z, l)]j (1.5) 


for i = 0,1. One can obtain a mean field ODE system as 


dzi 

dt 


b l f{z 2 ) 
/(z 2 ) + g(z 2 ) 


dz 2 

dt 


= jbzi - z 2 


( 1 . 6 ) 


when n goes to infinity through the perturbation analysis for the infini¬ 
tesimal generator I18J2T, 23 j • With suitable choice of the functions F[Z 2 ) 
and G(Z 2 ), the final mean field ODEs have two stable stationary points 
and there are noise induced transitions between these two states when 
n is finite. To understand the robustness of the genetic switching, the 
biophysicists employed the WKB ansatz to the stationary distribution Q] 

P(Zi,Z 2 ) ~ exp[-nS(zi,z 2 )] (1.7) 


and obtained a steady state Hamilton-Jacobi equation H[z\,z 2 , VS) = 0. 
Mathematically the function S resembles the role of the quasi-potential 
of the stochastic dynamical system fl2ll22ll32] but it is not sure whether 
it is the case in the current stage. Another related physics approach to 
study a similar switching system is to utilize the spin-boson path inte¬ 
gral formalism in quantum field theory and then take the semiclassical 
approximation and adiabatic limit |T9l [3T]|. Both approaches are difficult 
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to be rationalized in mathematical sense. So how to formulate this prob¬ 
lem in a mathematically rigorous way? To resolve this issue, we have to 
answer the following two fundamental questions. 

(1) Question 1. What is the large deviation principle (LDP) associ¬ 
ated with the system lll.2ll ? Presumably, we can obtain the La- 
grangian from the large deviation analysis, then get the Hamil¬ 
tonian H through the Legendre-Fenchel transform. 

(2) Question 2. What is the relation between the rigorously obtained 
Hamiltonian H in the above question and the Hamiltonian ob¬ 
tained via WKB asymptotics? 

The aim of this paper is to make an exploration on these two questions. 
To do this, we first note that the large volume limit no longer holds in the 
current example. Although the mRNA and protein copy numbers scale 
as V, we have only one DNA, which switches between the active and in¬ 
active states. This fact excludes the direct applicability of the LDP results 
in (261 - However, the fast switching between the two states of the DNA 
ensures the averaging technique still valid as shown in <11.61 1 by taking the 
quasi-equilibrium limit (81 US I2XI - We will show that the LDP analysis 
is also feasible by incorporating the Donsker-Varadhan type large devia¬ 
tions. Indeed, similar situation has been nicely discussed by Liptser 120] 
and Veretennikov Ell SO I for two-scale diffusions like 

dX n {t) = A{X n {t),Z n (t))dt + -^=BiX n {t),Z n (t))dW t , (1.8) 

yn 

d£n(.t) = nb{£, n {t))dt + \fna{£ n (t))dV t . (1.9) 

The main idea of this paper is to generalize the result in (20) to our two- 
scale chemical kinetic processes. As we will see, although the framework 
is similar, we have to deal with the technicalities brought by the jump 
processes and the full coupling between the fast and slow variables (£„ is 
independent of X n in 11.91 1). 

To state the main results of this paper, let us introduce the occupation 
measure v n on ([0, T] x Zd,BB{[0, T]) d) corresponding to £, n 

v„(AxT)= f l(teA,{„er)dt, Ae^([0,n),Te^(Z fl ), ( 1 . 10 ) 

Jo 

where T is any fixed positive real number. Denote D> rf [0, T] the space of d- 
dimensional vector functions on [0, T] whose components are right con¬ 
tinuous with left-hand limits, Mix. [0, T] of finite measures v = v[dt, i ) on 
([0, T] x Z D ,^([0, T]) ® &(Z D )) which are absolutely continuous with re¬ 
spect to dt and have Lebesgue time marginals, i.e. we have v{dt,i) = 
n v {t, i)dt, n v [t, i ) > 0 and n v (t, i) = 1. The v n we considered always 
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belongs to M^O, T], Take the metric p (2) on M^O, T] as the Levy-Prohorov 
metric and p (1) on D> d [0, T] as the Skorohod metric defined as 

p [1] {r,r) = inf j|| A||°v sup ||r(f) - r(A(f))|||, (1.11) 

1 fe [0,T] ’ 


where || • || is the Euclidean norm in the corresponding space, & is the col¬ 
lection of strictly increasing functions A(f) such that A(0) = 0 and A [T) = 
T, and 


sup 

0<s<t<T 


log 


A(f) - A(s) 


t-s 


D> rf [0, T] and Ml[0, T] are complete and separable spaces with p (1) and 
p [2 \ respectively CD. Our task is to establish the LDP for the pair (, z n , v„) 
in metric space (D> d [0, T] x |y L [0, T],p (1) x p (2) ). 

This paper is organized as follows. In Section 2, we present the main 
large deviation theorem and give the rate functional of the whole sys¬ 
tem. By using the contraction principle and the Legendre-Fenchel trans¬ 
form we get the Hamiltonian related to the slow variable z n . As a con¬ 
crete application, we then study the genetic switching model and com¬ 
pare the difference between the rigorously obtained Hamiltonian and 
that obtained by WKB ansatz. In Sections 3 and 4, we give the proof of 
the main theorem. Due to the technicalities to handle the non-negativity 
constraint for r, we decompose the proof procedure into two steps. In 
Section 3, we prove the LDT theorem by relaxing the bounded domain 
condition to the whole space case. The upper bound estimate is standard 
in some sense. However, the proof of the lower bound is technical be¬ 
cause of the full coupling between the fast and slow variables. The reso¬ 
lution is based on the approximation and change-of-measure approach. 
The central idea is to make a piecewise linear approximation to any given 
path and occupation measure (r, v) by (y,n) at first, and then construct 
suitable new processes {z n ,v n ) such that P - lim„^ 00 p tl) (z„, 3 /) = 0 and 
P - lim^oo p (2) [y n , 7t) = 0. This turns out to be technical and one key part 
of the whole paper. In Section 4, we strengthen the result to the half space 
case. Some details are left in the Appendix. 

This paper should be considered as the companion of fT9ll2ll for study¬ 
ing the rare events in genetic switching system, and it is of general inter¬ 
est to understand the large deviations for multiscale problems (Zl[8). 


2. Main result and its application 

2.1. Main theorem. We need the following technical assumptions for our 
main result. 
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Assumption 2.1. Let W := Uf. Assume the following regularity conditions 
for the propensity functions and jump rates hold. 

(1) (a) For each i e {1,2,...,S}, j e Z D and all z,x e W, the Lipschitz 
condition holds 


\Xfiz, j) - Xfix, j)\ < L\\z - x\\. 


( 2 . 1 ) 


(b) For each i e {1,2,...,S}, j e Zd and all ze W°, A i{z,j) > 0. 

(c) For each x e dW and y e ^{ufiAj (x) > 0}, we have x + sy e W 
for some s e (0,oo) , where c tS{Uj \ is the positive cone spanned by 
the vectors {Uj} defined as 


^{ufi := {v\ there exist otj > 0 such thatv = J^jOtjUj}. (2.2) 


(2) For each i,jeZ D , log (z) are bounded and Lipschitz continuous 
with respect tozeW. 

These assumptions hold in our application example in Section l2)2l 

Theorem 2.2. Under the Assumption ^. H the family {z n ,v n ) defined by 
(ll.lt and 11.101 obeys the LDP in (D> rf [0, T] x iy L [0, T],p m x p (2) ) with a 
good rate functional I[r,v ) = 7 s (r, v) + //(r,v), i.e. 

(0) I (r, v) values in [0, +oo] and its level sets are compact in (B d [0, T] x 


M L [0,T],p [1] xpW), 

(1) for every closed set F e B rf [0, T] x M L [0, T], 



(2.3) 


(2) for every open setGe P rf [0, T] x T], 


liminf—logF((z„,v„) £ G) > - inf 



(2.4) 


where the rate functional for the slow variables 



(2.5) 


L s [z,p, w ) = sup {(p,p)~ H s (z,p, it/)), 


( 2 . 6 ) 


peU d 



(2.7) 


and the rate functional for the fast variables 



( 2 . 8 ) 
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S(z, w) = sup S(z, w,a), (2.9) 

treR - 0 

D 

S{z, w,ar) = - £ Wiqijiz) - lj. (2.10) 

i>j = 1 

Here we take the notation v{dt, •) = n v (t, ■)dt, thus n v (t, •) is a probabilis¬ 
tic vector (n v (£, 1), n v {t, 2),..., n v {t,D)). w = {w\,W 2 , ... ,Wd ). and (■,•) 
is the inner product in the Euclidean space, = e, - e 7 and {ef}P 7 are 
canonical basis in Euclidean space M ,) . We take the convention that r(t) 
is absolutely continuous with respect to time when we use the notation 
dr{t) = r{t)dt, and S is a function of{z,w) (or ( z,w,a)) when we use 
S{z,w) (or S{z,w,a)) by default. 

The proof of Theorem 12.21 relies on first establishing a weaker state¬ 
ment based on the following stronger assumption on the whole space. 

Assumption 2.3. Regularity for the propensity functions and jump rates. 

(1) For each i e {1,2,..., S}, j e Z D , log A* (z,j) is bounded and Lips- 
chitz continuous with respect to zeU d . 

(2) For each i,je Z/j, log c.pj (z) are bounded and Lipschitz continuous 
with respect to zeU d . 

This covers Assumption ^. 11 Mathematically we express (1) as 

j<Xi(z,j)<A, A > 1 (2.11) 

for any z e [R d , i e { 1,2,..., S} and j e Zj> And in this stronger set-up we 
simply denote the positive cone generated by {uf as 

:= {i>| there exist aj > 0 such that v = Lj a i u i\■ [2.12) 

Theorem 2.4. The large deviation result in Theoreml2(2holds for (z n ,v n ) e 
D> rf [0, T] xU L [0, T] under the Assumption ^. 3[ 

As a straightforward application of the contraction principle, we have 

Corollary 2.5. The slow variables z n obeys the LDP in (O rf [0, T],p (1) ) with 
the rate functional 

/(r)= inf U s (r,v) + I f {r,v)). (2.13) 

veMpO.T] 1 

Define the set of probabilistic transition kernels on Z^ as = {w : 
W\, W 2 ,---, wd - u>i = 1} where w = [wi, W 2 , •••, Wd )• We also de¬ 

fine the reduced Lagrangian as 

L(zf 3)= inf {L s {z,f}, w) + S{z, w)}. (2.14) 

we Ab 
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For convenience, we will abuse the notation n v e Mix [0, T] and v e Mix [0, T] 
in later texts. 


Lemma 2.6. For any r(-) which is absolutely continuous, we have 

inf f L s (r(t),r(t),n v (t,-)) + S(r(t),n v (t,-))dt 
« v eMi[0,r] Jo 

T 

L[r[t),r{t))dt. (2.15) 



Proof. First let us show the measurability of the integrand on the right 
hand side of Eq. 12.151) . By Lemma lA2l L s (z, p,w) + S (z, w) is convex in w. 
So L s (z, p, w) + S(z, w) is continuous with respect to w in the set A° D c U D 
and the interior of the low dimensional boundaries of Ax>. Choosing a 
countable dense subset in Ax>, we have 

L(r(t), r(f)) = inf \L s {r(t), r(f), w k ) + S(r(f), w k )\ (2.16) 
k> l 1 J 

for every r by the continuity condition. The measurability is a standard 
result with this formulation. 

It is straightforward to have that 

inf f L s (r(t),r(t),n v (t,-)) + S(r(t),n v (t,-))dt 

« v eMi[0,T] Jo 

> f L[r{t),r{t))dt. 

Jo 

Now let us show the converse part. For any given e > 0, define the sets 


A k = {tc[ 0, T]:Ur(t),r(t))- 

L s [r{t),ir{t),w k ) + S{r{t),w k )j > -c/r| 


for k > 1. We have that A k are measurable sets since L s (r[t), r[t), w k ) + 
S(r(t), w k ) and L{r{t), r{t )) are both measurable functions of t. Define 
the measurable functions 

F k (t) = \ k ’ t£Ak \ 

I +oo, otherwise 


for every Jc > 1 and 

/(f) = infF fc (f). (2.17) 

k> 1 

It is not difficult to find that /(f) < +oo for any f, /(f) is measurable and 
takes values in positive integers. With these definitions we have 

L(r{t), r(f)) > L s {r{t), r(f), n/ (f) ) + S(r(f), n; /U) ) - el T. 


(2.18) 
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With w J[t) := { w [ w , w 2 t] ,■■■, }, define the occupation measure 

v{dt, i ) = w JW dt, i e {1,2, • • • ,D}. 


v 


Then ve MfifO, T], n^{t, i) = and 


f 

■f 


L{r(t),r[t))dt 

L s {r[t),r{t),n^[t,-)) + S{r{t),n^[t,-))dt-e 

T 


> inf [ 

w v eM L [0,r] Jo 

The proof is completed. 

By Lemma lZSl we have 

7{r)= inf (7 s (r, v) + //(r,v)) 

veMi[0,r] 


L s (r(t),r(t),n v (t,-)) + S(r(t),n v (t,-))dt-e 


= inf f 

nveMitO.T] J 0 

-f 


L s {r{t),r{t),n v {t,-)) + S{r{t),n v {t,-))dt 


□ 


L[r{t),r{t))dt. 

Lemma 2.7. L(r, /3) is convex in p . 
Proof. By Lemma IA. 31 


(2.19) 


L{z, fi) = inf {L s {z,p, w) + S{z, w)} 

weAd 

= inf sup«p,/3>-77 5 (z,p, w) + S{z, w)) 

weA ° peR d 

= sup inf {(p,P) - H s {z,p,w) + S{z,w)). 

peRd weA d 


It is easy to see that inf W e\ D {{p,P) - H s (z,p, w ) + S(z, w )) is linear in p, 
thus L(r, p) is convex in p according to Lemma lAdil □ 

It is well-known that the Lagrangian L s does not have a closed form for 
the standard chemical reaction kinetic system, instead it is more conve¬ 
nient to investigate its dual Hamiltonian H s by Legendre-Fenchel trans¬ 
form. The explicit form of the Hamiltonian is important for the numerics 
to study the rare events in systems biology |T5|. With similar idea, we 
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have 


H{z, p) = sup {(p, (}) - L{z, P)) 


sup 


{p,P)~ inf {L s (z,p, w) + S{z,w)} 

we\ D 


= sup sup ({p, P) - L s {z, p,w) - S(z,w)) 

l weA d 


= sup sup ({p,p)-L s (z,p, w)-S(z, w)) 

WE\d f}ER d 

= sup ( H s {z,p,w)-S(z,w )). 

WE Afl 


( 2 . 20 ) 


A consequence about H from its definition is that H is convex with re¬ 
spect to p from the convexity of L and the Legendre-Fenchel transform 
®. Furthermore if the matrix Q = (^ylDxD is symmetrizable, S(z, w) has 
an explicit expression 0 

( 2 . 21 ) 


S{z,w) = ~Y,Y, v wtfijW - V MjVjiW 

z i jfi 


2.2. Application to the genetic switching model. The formula 12.201 1 has 
a nice application in the genetic switching model introduced before. In 
this model, we have d - 2, D = 2 and S = 4. By parameters shown in 11.41 1 
and TablelU we have 

H s {z, p, w) = b~ l wx ( e Pl - 1) + A{zi, z 2 , pi,pz), (2.22) 

where z = {z\, Z2), p = (/h, P2), = ( Wq, W\) (here we utilize the notation 

w = {w 0 , Wi) instead of w = [wi, w 2 ) as mentioned in the introduction 
since there is only one molecule of DNA) and A{zi, z 2 , p\,p 2 ) = jZi[e~ Pl - 
1) + jbz\{e P2 - 1) + z 2 {e~ P2 - 1). We also have 

S{z, w ) = w 0 f(z 2 ) - \/wig{z 2 )^ . 

Applying 12.201) with the constraints Wq+ W\ = 1 and w 0 , wi > 0, we obtain 
the final Hamiltonian 

2 

H{z,p ) = b~ l s{e Pl - 1) - (^(1 - s)f[z 2 ) - y/sg{z 2 )} + A{zi,z 2 ,p 1 ,p 2 ), 

(2.23) 

where 

1 | si ' b~ l {e Pl - 1) + f(z 2 ) - g(z 2 ) 

2 2^sl + 4 1 Vf^2)giz 2 ) 
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It is instructive to compare this Hamiltonian with that obtained via 
WKB asymptotics. In |T), another form of the Hamiltonian for this sys¬ 
tem is given via WKB asymptotics: 

mz, p) = A + gizzV 1 [A + b~ l (e p i - 1)] [/(z 2 ) - A], (2.24) 

where A = A(zi, z 2 , pi, p 2 ). The relation between the Hamiltonian H and 
H is not clear so far. But one crucial difference is that H is convex with 
respect to the momentum variable p from the form 1 12.201) . while H is 
not. It turns out this property is crucial for the numerical computations, 
especially for computing the transition path in geometric minimum ac¬ 
tion method (gMAM) (T5). It is also interesting to observe that the quasi¬ 
potential S(zi, z 2 ) obtained from 

H(z,VS) = 0 or H(z,VS) = 0 


is the same even H and H are so different ED. It can be also verified 
that H is not the convex hull of H with respect to p. From the Hamilton- 
Jacobin theory, one may speculate that these two Hamiltonians are con¬ 
nected through some canonical transformation. But it is only a plausible 
answer which is difficult to be verified even for this concrete example. 

As the large deviation results give the sharpest characterization of the 
considered two-scale chemical kinetic system, we can obtain the deter¬ 
ministic mean field ODEs and the chemical Langevin approximation for 
the system based on the large deviations (5), which corresponds to the 
law of large numbers (LLN) and the central limit theorem (CLT) for the 
process. Taking advantage of 112.231) . we get 


dH 


b l f{z 2 ) 


dpi p= o /(z 2 ) + g(z 2 ) 
The mean field ODEs defined by 
dz\ dH 


JZ\, 


dt dpi 

are exactly (11.6D . 

Furthermore, we have 

d 2 H 


p=0 


dH 


dp 2 


p =o 


jbzi-z 2 . 


and 


dz 2 dH 


dt dp 2 


p=0 


b l f{z 2 ) 2b Z f{z 2 )g{z 2 ) 


-2 


+ 


dp{ P=° fiz 2 ) + g(z 2 ) (/(z 2 ) + g(z 2 ))- 


+ JZl, 


dr H 


dp 


p=0 


= jbzi + z 2 . 


(2.25) 


(2.26) 
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This naturally leads to the following chemical Langevin approximation 


d Z\ 
dt 


b~ l f 
f + g 


-yz i 




2 b 2 fg 
(f + g) 3 


dB) 


sJyzidB 3 , 


dZ2 

dt 


Wbzi - zf] dt+ —— 
\jn 


\Jjbz\dB 3 - y/z^dBf , 


(2.27) 


where f,g are abbreviations of functions f(Z 2 ) and g(z 2 ), and B\ (i = 
1,... ,4) are independent standard Brownian motions. It is instructive to 
compare 12.271 with a granted formulation by naively transplanting the 
Langevin approximation from the simple large volume limit HU, where 
the equation for z\ reads 


dz\ 

dt 


b~ l f 
f + g 


-yzi 


dt -t— -— 
sjn 



dB] 


\fyz\dB 3 , 


(2.28) 


and the equation for z 2 is the same. It is remarkable that the Eq. 12.271 ) has 
an additional term related to the noise dB ]. This additional fluctuation 
is induced by the fast switching of DNA states. Similar situation will also 
occur when we derive the chemical Langevin equations for enzymatic re¬ 
actions, whereas we should take the fluctuation effect of the fast switch¬ 
ing into consideration if the considered scaling is in our regime. However, 
this point does not seem to be paid much attention in previous research. 
Similar situation is further discussed in [19]. 


2.3. A useful property of the Hamiltonian H. The Hamiltonian II(z,p) 
has some nice properties which can be utilized to simplify the computa¬ 
tions in many cases. Assuming that Q = (qij)DxD is symmetrizable, ac¬ 
cording to 12.201 1, we have 

H(z,p) = sup h(z,p,w), 

we Ajj 

where 


h(z,p, w) -H s {z,p, w)-S(z, w) 


= i(z,j)Wj(e^ u d-l) 


;=!./=] 

- 5 LL 

Z i j?i 


yj m q, j (z) — yj w j q j(z) 


We will show that the supremum of h in Ao can be only taken in the 
interior of A^. To do this, we first note that h is continuous in A^ 
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and differentiable in A^. For any wo £ d(Ar>), define v = Co - Wb where 
Co = (1,1,..., 1)ID is the center of A^. It is easy to check that 

lirn - 1 h{z, p, wb + tv) - h{z, p, w^) j = +oo. (2.29) 

This means that the sup remum of h can not be taken in d(A£>). Further¬ 
more, since h is strictly concave in w, there exists only one point w* in 
A° d , such that 

w* - argsup h{z,p, w). 

WE&D 

An important consequence of this fact is that we can get the derivative 
dH{z,p ) _ dh{z,p, w*{p)) 
dp dp 

_dh(z,p,w*) dh dw*[p) 
dp dw w=w* dp 

_ dH s {z,p, w*) 
dp 

This is very useful to simplify the derivations when utilizing the gMAM 
algorithm (T5] to explore the transition paths. 

3. Proof of Theorem I2.4I 

We will mainly follow the framework in (20] 261 to make the proof. First 
we prove the upper bound and then the lower bound. 

3.1. Upper Bound. The proof of upper bound (12.3D is standard in some 
sense. It is difficult to estimate the probability of (z„, v„) e F directly. We 
proceed with the following steps. Firstly, we approximate z n by z n , where 
z n is an absolutely continuous path. Secondly, for a given compact set, 
we can get an upper bound for (z„,v„). Thirdly, we prove that after ex¬ 
cluding a set of exponentially small probability, z n and v n stay in com¬ 
pact sets, which means that z„ and v n are exponentially tight sequence. 
And finally, we get the desired result by combing the previous steps with 
further estimates. 

Before proceeding to the proof, let us denote C rf [0, T] the collection of 
all continuous functions of t £ [0, T] with values in [R rf . Define the sup- 
norm for any r, r e C d [0, T] 

p { c\r,r):= sup ||r(f) - r(f)||. 

0<t<T 

We have that (C rf [0, T],p^) is a Polish space. The metric p^ } is stronger 
than on B rf [0, T], As a consequence, every open set in (D> ri [0, T],p (1) ) 
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is also open in (D> d [0, T],p^). And if^ is compact in (C rf [0, T],p^), it is 
also compact in (D> rf [0, T],p^) and in (D> rf [0, T],p m ). 

To construct the approximation of z n , we subdivide the time interval 
[0, T] into n pieces with nodes tj = T jin, j = 0,1, ■ • •, n. Define the piece- 
wise linear interpolation z n {t) of z n {t) as 

Znit) = {1 ~Yj(t))z n {tj) +Yj(t)z„{tj +l ), te [tj,tj +1 ], (3.1) 

where Jj{t) = {t- tj)n/T e [0,1]. 

We have the important characterization that z„ is exponentially equiv¬ 
alent to z n . 

Lemma 3.1. For each 8 > 0, 

limsup —loglP(p (1) (z w ,z n ) >8) = -oo. (3.2) 

«—>oo n 

The proof of Lemma l3.1l is left in the Appendix. 

For given compact sets in C rf [0, T] , the following quasi-LDP upper bound 
for (, z n ,v n ) holds. 

Lemma 3.2. Fix step functions 6 (f) e [R rf and a(f)eR D . For any 8 > 0 and 
compact sets e C rf [0, T] and 5? e y L [0, T], we have 

limsup-logP((z„,v, 2 ) g J6 x ST) < - inf (if (r, v,0) + I s Jr, v, a)) , 

n—’oo n (r, v)e^x^ \ J J 

where 

T s (rvR\-\ fo L s s (r{t),r,n v {t,-),0(t))dt, dr(t) = r{t)dt, 

( oo, otherwise, 

L s s (z, p, w, p) = (p,p)~ Hf (z, p, w), 


(3.3) 

(3.4) 

(3.5) 


and 


Hs (z, p, w) = sup H s (x, p, w ), 

\x-z\<8 


lS f (r 


, v, a) = f 
Jo 


S d (r(t),n v (t,J,a(t))dt, 


D 


S 5 [z, w,a) = - sup Y Wjqijiz ) - l). 

\x-z\<8i,j=i v ' 


(3.6) 

(3.7) 

(3.8) 


Before the proof we remark that H s s {z,p, w) andlf(z,/5, w,p ) are mono- 
tonically increasing and decreasing functions of 8, respectively. S 5 (z, w, a) 
is a monotonically decreasing function of 8. Correspondingly, if (r, v, 6 ) 
and v, a) are decreasing functionals of 8. 
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Proof. We only need to consider absolutely continuous functions r on 
the right hand side of Eq. ( 13.31 1 since if (r, v,0) + I d {r, v, a) = oo otherwise. 
For any r and v, define the sum 


n— 1 ( 

J n {r,0,v, a) = Y 
7=0 


r{tj +l )-r(tp,6(tp 


-£ J+1 H s s [r{tp,0(tJ),n v {t,-)) dt + S 5 (r(tp, 




(3.9) 


By Corollarv lA.8l in Appendix, we have 


limsup —logEexp {nj n (z n ,0,v n ,a)) < 0. 
n—»oo Yl 


For (z n , v n ) g Jd x sf, it is obvious that 


J n (z n ,0,v n ,a)- inf J n {r,0,v,a)> 0. 

x£f 


(3.10) 


(3.11) 


So we have 


exp 


Jn(z n ,0,v n ,a)- inf J n {r,0,v,a)\> 1 

(r,v)eJ 


and 


p((z, 2l v, 3 ) g jr x^) 
< Eexp^n 


J n (z n ,0,v n ,a)- inf J n {r,0,v,a ) 

(r,v)ejff xSf 


Combining this with (13.101) . we get 


1 ( 

limsup — logP((z w ,v„) g JF x y) < -liminf 

n—>oo Tl n ~ 


inf J n (r,0,v, a) . 

{(r,v)ejff x^ J 

(3.12) 

We now represent the sum on the right hand side of 0.121 ) as an inte¬ 
gral. Since Jd is compact, the absolutely continuous functions r g Jd are 
thus uniformly bounded. Fet V be a compact set in U d such that 

{z: z - r{t) for some r g Jd and t g [0, T]} c V. 

For step function 0, let us investigate an interval in which 0 takes con¬ 
stant value 0 O , say, the interval [0, r] without loss of generality. Then 

w-i \ r T 

El(t; 1 vl\ r ( f i+i)- r ( f /)- 0 o/ = J o ( r,0 o )dt+e n , 

where the error e n takes into account the fact that r may not match any 
of t'f It goes to zero uniformly for r e Jd when n goes to infinity from the 
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bound 


2 T „ 

\e n \ ^ —|0 o lsup|z|. 

n zeV 


Now Hf (z, p, w) is continuous in z, p and w from the continuity of H s 
on x,p and w and the boundedness of A/, 0 and n v {t, •) in the current 
setting. So we have 


(r(f?) > 0(fp, n v [t, •)) - H s s (r{t),0{tp, n v (t, •)) 


t n < t < f” , 
’] ~ N+i 


goes to zero uniformly in j for r e if and v e M by equi-continuity. 
Therefore, 


«-i r f /+i a \ 

Ell^sr) J n H^r(tj),6(tJ),n v (t,-)jdt 

j~ 0 v 

with e„ converging to zero uniformly in (r, v)eJTxy. 

Similarly we can estimate for the part S s {r{tp, n v (t, •), ct(tp) and re¬ 
peat the argument on the finite number of intervals on which 6 and a 
are constants. Thanks to the uniformity in (r, v) e JF xy,we obtain 


liminf 

n—>oo 




inf J n {r,e,v,a) |= inf J/f(r,v,0) + I 5 f {r,v,a)). 


□ 


(r,v)eJ£T xSf 

Together with H3. 12t . the proof is completed. 

Next we show the exponential tightness of the sequence (z n ,v n ). De¬ 
fine the modulus of continuity of a continuous function z as 

Vg (z) = sup{||z(f) — z(s) || :0< s< t< T,\t- s\<8} (3.13) 

and the set 

1 


m=M 

for any fixed Me N. 


JF(M) = p| izeC d [0, r]:z(0) = z 0 J T 2 -™(z)< 


logm 


(3.14) 


Lemma 3.3 (Exponential tightness for z n ). For each B> 0, there is a com¬ 
pact set JF c C d [0, T] such that 

limsup —logP(z„ £ JF) < -B. 
n—>oo n 

Proof. For any fixed M e N, it is not difficult to see that the set JF (M) is 
closed and the functions in F7F (M) are equicontinuous. Thus JF (M) is 
compact by the Arzela-Ascoli theorem. If 2~ m < TI n, we have 

1 

V^-m-l (Z w ) — — {Z n ) 
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since z n is piecewise linear. Therefore, to check whether z n is in (M), 
we only need to consider a finite intersection, for values of m up to 

'log {n IT)' 


M{n) = maxt M, 


l°g 2 


Using Corollary IA.6l in Appendix, we have for any n with M(n) > M, 


M(n) 


nz n t JT(M)) < £ 


m=M 


V-z-m (Z„) > - - 

logm 


M(n) n -1 j 

< X SU P \Zn(t?+t)-Z n (.t?)\> 

m=Mj =0 V0<t<2-”‘ 

2 m c 2 ) 


log M 


< nM(n)-2dexp 
for positive constants C\ and Cz- Thus 


-n- 


c 1 

log M 


log 


\logM 

M 


)) 


limsup — logP(z„ £ J6 (M)) < -c- 
n^oo n log M 

for some positive constant c when M » 1. 

Lemma 3.4. The measure space [0, T] is compact. 


□ 


Proof. Since [0, T] x {1,2,..., D} is compact, M L [0, T] is tight. By Prohorov’s 
theorem, Mh[0, T] is relatively compact. Let v be the limit of any con¬ 
verging sequence {v m } in MUO, T}. Since Y.f =l Vmidt, i) = dt for all m, 
we have l v{dt, i) = dt and thus v{dt, i ) « dt. So v also belongs to 
M l [0, T]. This proves that Ml [0, T] is compact. □ 


The straightforward consequence of Lemma l3.4l is that v n is also expo¬ 
nentially tight. 

Define the quasi-rate functionals for slow and fast variables correspond¬ 
ing to I s and If in Theorem l2.2l 


/f(r,v) 


Jq L s s [r{t),r{t),n v {t,-))dt, dr{t ) = r[t)dt, 
oo, otherwise, 


(3.15) 


L s s (z, p, w) = sup L s s (z, p, w, p), 

peU d 

(3.16) 

r T 

If{r,v) = J S°(r(t), n v {t, -))dt, 

(3.17) 

S 5 (z, w) = sup S 5 (z, w,a). 

(3.18) 


<7£|R D 


The definitions of L 5 s {z,p, w,p ) and S 5 (z, w,a ) are referred to 1 13.51 1 and 
H3.8L We have the following approximation lemmas. 
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Lemma 3.5. For any e > 0, the absolutely continuous function r e <C rf [0, T] 
and v e M^O, T], there exists neighborhood N r]V e C rf [0, T] x Milo, T] of 
(r,v), step functions 6 rv c U d and a rv c U D , such that for any q £ N r and 
pe N v which are both absolutely continuous, we have 

Is (< 7 > h’Orv) + I S f iq, IF a rv) ^ Ig ( r > v ) + If (**, v ) “ 

Lemma 3.6. For any pair [r ,v) e <C d [0, T] x y L [0, T] and Mo > 0, ifr is not 
absolutely continuous, there exists neighborhood N r>v e <C rf [0, T] x|y L [0, T] 
of{r,v) and step functions 6 rv e U d anda rv e IR D , such thatfor any [q,p) e 
N r< y, we have 

I d lq,p,e rv ) + I S f {q,p,a rv )>M 0 . 

The Lemmas I3.5l and l3?6l are direct consequences of Lemmas IA. 1 01 and 
lA.lll in the appendix. 

Simply denote the product metric p (1) x p (2) on D> rf [0, T] x y L [0, T] as 
d{-, •) and define the sets 

0{K) = |(r,v) e U d [0, T] x M L [0, T ]: I s (r,v) + I f {r,v) < K } (3.19) 

and 

O' 5 (K) = {(r, v) g U d [0, T] x M l [0, T]: I 6 S (r, v) + I s f (r, v) < i<:}. (3.20) 

We have the following characterization for O(iL) and <E > 5 [K). 

Lemma 3.7. For any K > 0, the level sets O [K) and O 6 [K) defined in 0.1911 
and Q.20I I are compact sets. 

Proof By Lemma l3~4l Mh[0, T] is a compact set. By Lemma lAT)! the func¬ 
tions r g O(iL) are equicontinuous. Combining with the fact that r(0) = 
z°, we have that O(iL) is pre-compact. BvLemma lA.lQI I s (r,v) + If{r,v ) is 
lower semicontinuous. Consequently O(iL) is closed and thus compact. 
The proof for O' 5 (K) is similar. □ 

Proposition 3.8. For each K > 0, 6 > 0 and e>0, 

limsup-^logP ^d |(z„, v„),0 5 (f<r)j > erj < -( K-e ). 

Proof From the exponential tightness, we can find a compact set Jd N g 
C d [0, T] for each N > 0 such that 

limsup — logP(z„ £ ,7F ,v ) <-N. 

n—>o o n 

Define the set 

JP N ' e = |(r, v) g C d [0, T] x M l [0, T ]: d ((r, v),O 5 (i0) > e}n(Jf N xM L [0, T]). 
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For any (r,v) e Jd N,e , we can find the neighborhood N r<v either satisfy¬ 
ing Lemma 1331 if r is absolutely continuous, or satisfying Lemma [3751 if 
r is not absolutely continuous. This forms a covering of Jf N,£ . By com¬ 
pactness, we can choose a finite subcover {N riiVj }ij for JS N ’ e . Define 


Jfij = Nr itVj n Jd N ’ e . 

Applying Lemma [3l2l Lemma [3751 Lemma I3T61 and letting Mo in Lemma 
I3.6l larger than K, we have for any i, j, 

limsup-log P((z n ,v n )eJfij) <-(K-e). 

n—>oo fl 


Then we have 


limsup — logP id((z n ,v n ),O s (K]\ > e) 

n—>oo n ' ' ' ' 


1 


< limsup —log 

n—>oo Tl 


P{z n £ JP N ) + £ P((z„, v n ) e JCij ) 
hi 

< - min {N, K-e}. 


Choosing N large enough, we complete the proof. 


□ 


We are now ready to establish the upper bound. 

Lemma 3.9. Given K > 0 and e > 0, there exist 8 > 0 such that 
O 5 {K-e) c {(r,v): d((r,v),®(lQ) < e}. 


Proof. Prove by contradiction. If the claim is false, we can choose 
Si l 0, (r i} Vi)£<h 5i {K- e ), i = l,2,- 


such that 


d{{r it vO,O {K))>e, Vi. (3.21) 

By definition of /f(r,v) and lj(r,v), we have the monotonicity if (r,v) < 
if (r,v) and 7^(r,v) < I^'{r,v) when 8 > S' > 0. Thus the sets <$ Si (K-e) 
are monotonically decreasing as <5, | 0, and (r,-, v,-) are contained in the 
set O 51 (iC - e) which is compact by Lemma 13771 So there exists a subse¬ 
quence convergingto (ro,v 0 ). With Lemma lA.lOl in the Appendix we have 
for each j 

if (r 0 ,v 0 ) + I S f ] (r 0 ,v 0 ) < liminf(/f J (rj,v ! ) + /^(r i ,v ! )] 

< liminf(/f‘'(r/,v f ) + v,-)] 

/—►OO v J J 

< 7C-c. 
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The monotone convergence theorem gives 

I s (r 0 ,v 0 ) +If{r 0 ,v 0 ) = lim I S s J (r 0 ,v 0 ) +I S J{r 0 ,v 0 ) 

j—oo J 

< K-e. 


So (r 0 ,v 0 ) g O(F). For sufficiently large i, d((r 0 ,v 0 ), (r/, v,-)) < e. This 
contradicts with <13.211 1 . □ 

Theorem 3.10. For each closed set F c: D> rf [0, F] x y L [0, T], 

limsup — logP((z„,v„) g F) < - inf [l s (r, v) + I f (r, v )). 

n —*oo yi (r ,v)gF 

Proof. Suppose inf( r> v)ef(fs(r,v) + )) = K <oo. Since F and O(F-e) 

are both closed sets, we assume the distance between them is 770 > 0. For 
any ri < 770 , 


P((z„,v„) gF) 

< p[d((z„,v„),F) < + P > (d(z„,v„),(z, 7 ,v„)) > 

< p(d((z„,v„),0(F-c))>|) + p(p m ((z„,z w )>|) (3.22) 

By Lemma l3^9l we can choose S and 77 small enough such that 

d({z n ,v n ),®{K-e)) > | implies d((z„,v„),<F 5 CF-e:-77/4)j > 
From Proposition l3.8l we have 

limsup —logP id ((z„, v„),0(F-c)) > 

n—oo 77 V 27 

< limsup — logP [ d ((z„, v„), O 5 (F - e - 77/4)) > 

n-oo 77 V V 7 47 

< -{K-e-rjIZ). (3.23) 


Combining H3.22L <13.2311 and Lemma l3TTl for d = 77/4, we obtain 
limsup - logP((z n , v„) gF) < -(K-e-rj/2). 

«—>00 77 

The case for 

inf (l s {r,v) + If(r,v)) = 00 

( r,v)eF 

can be established similarly by choosing K arbitrarily large. □ 
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3.2. Lower bound. The proof of the lower bound is based on the change 
of measure formula. From (5), it suffices to prove that for any (r,v) e 
D> d [0, T] x M l [ 0 , T] and arbitrarily small e > 0 we have 

liminf—logP (z n e N e {r),v n e iV e (v)) > - [l s [r, v) + 7/(r,v)), (3.24) 

where A/e(r) is the e-neighborhood of r in D> rf [0, T] with metric p (1) , and 
lV e (v) is the e-neighborhood of v in Mh[0, T] with metric p (2) . For given 
r e 0 d [0, T} and v e Mh[0, T], if r is not absolutely continuous, I s {r,v ) + 
If{r, v) = oo, thus nothing needs to be proved. Below we will exclude this 
case. For convenience, we further assume that n v (t, i ) is continuous in t, 
and the case that n v {t, i ) is not continuous will be discussed in Theorem 
I3.17l in this section. To prove the lower bound, we perform the following 
steps. Firstly, we approximate r by a piecewise linear path y, and the 
occupation measure v by n e MfilO, T] with piecewise constant 

in t. Secondly, we construct new processes z n and with occupation 
measure v„ such that 

P - lim p™ {z n , y) = 0, P - lim p [2) ( v n , 7r) = 0, (3.25) 

n —oo n —oo 

where the notation P - lim means the convergence in probability. More¬ 
over, we ask z n and the jump rates of satisfy the conditions required 
by Lemmas [3.1 II and l3. 121 Finally, based on the change of measure for¬ 
mula related to (z„, and ( z n , <f n ), we get the limit and the proof is then 
finished. 

As promised in the above procedure, we approximate r by a path y 
first. For a given /, define A = T/J and let t m = mA. On each interval 
[t m , t m+ 1 ], define A r m = r[t m+l ) - r[t m ). Take n' n = = 1,...,S} so as 

to satisfy 

S A r 

p'^Ui = —— and p'” > 0. (3.26) 

i=i ^ 

If A r m are in the positive cone generated by the {iq} for all m, such a 
choice of fi m is possible. If at least one of A r m is not in the positive 
cone generated by the {tq} , it is easy to check that for all v £ M[0, T], 
I s (r,v ) = +oo (see the Remark of Lemma 5.21 in (261) and nothing needs 
to be proved. 

Now we construct the piecewise linear interpolation y of r such that 
y(fo) = J'Uo) and in each time interval t m +i\ 

= !>><■ 


( 3 . 27 ) 
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Thus y[t m ) = r{t m ) for each m. For any e > 0, we can choose / large 
enough such that 

p [ c\y,r) < c/4. 

Define the sets 

f D D 1 

&’ = \(ri,y/)\Ti={Tiij) DxD , tiij> 0; (3.28) 

i=i ;=i 

and 

f s l 

= |/i £ U s : m > 0, £ Hi u i = p\- (3-29) 

We remark that the sets and JFp here have nothing to do with the def¬ 
initions in the proof of upper bound. 


Lemma 3.11. For any c > 0 and large enough J, there exists a further 
subdivision of time interval [t m , t m+ \] for each m £ {0,1, •••,/- 1} (i.e., 
t m = t m 0 < tmi < ••• < t,nK m = t m+ i) and related (rf lk ,\fj mk ) £ SP (m = 
0, !,•••,/ - 1; k = 0, !,••• ,K m - 1), such that 


J— 1 K m — 1 n 

L L / 

m =0 k =0 

< If{r,v) +e. 


■m,k+\ 


D 


D 


,mk 


i= 1 


LyT k L + miWn-’i?*)* 


and 

\\y/ mk -n v (t,-)\\<e/(ADT) (3.30) 

for all te [t mk , t mMl ), k = 0, !,••• ,K m - 1 and m = 0,1, 


The proof of Lemma l3.11l can be found in the Appendix. 

We then define the measure n e Mh[0, T] such that n{dt, i) = n n {t, i)dt 
and 

flnit, i)If/1 ", t £ [t m k, t nit k+\) 

for m = 0,l,---1 and k = 0, l,---, K m - 1. With this choice n n {t,-) is 
piecewise constant and 

p [2 \n,v) < cl A. 

We take the frequently used notation Xf in later text as the expectation 
of Ai with respect to the distribution n n 

D 

A 7 j{y(s)) = ^Af(y(s),7)n w (s,j). 

7=1 


(3.31) 
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Lemma 3.12. For any e > 0 and large enough J, define P m = Ar m IA, then 
there exists p m e Kp m such that 


J 1 C tm +1 ^ i 

E EAfcyto)-/*?+/<? log 

1 = 1 v 

< I s {r,v)+e. 


hi 


A7(y(f)) 



The proof of Lemma l3.12l can be found in the Appendix. 

With the constructed matrices {ri mk } in Lemma l3.11l we define the pro¬ 
cess with jump rate nrjijit ) where r/ijit) = r)™ k , te [t mk , t m j fc+ i). Simi¬ 
larly, we take fi m constructed from Lemma l3TT2l and define z n with jump 
rate 


npdt) 


Ai{z n (tU„(t)) 

A7(y(f)) 


for its z'th component, where pft) is piecewise constant and p;(t) = p'f 
for te [t m , t m+ i). 

We have the following convergence result for the constructed approxi¬ 
mations for n and y. 


Lemma 3.13. Convergence of the approximation v n 

P>- lim p (2) (v",7r) = 0. 

72—OO 

Lemma 3.14. Convergence of the approximation z n 

P- lim p { }\z n ,y) = 0. 

72—00 L 

The proof of Lemmas l3. 13113.141 will be given in the Appendix. 

As we have finished the construction of z n and we now perform the 
change ofmeasure. Denote <Q>„ and<Q>« the distributions of (z„(f),4 n (t))f<r 
and (z„(f),| n (f)h<r> respectively. We have 




exp 


-f»t 

l 4o , = i 


/ 


A i{z n (t),£ n (t))- pdt) 


=1V 


A7(y(f)) 




T D 


(y(r)) 


f Elog _wiLL^ 

to t" B <fy(*„(r)) ' 


._ e B(z n g n ) 


(3.32) 
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where Y l t is the counting process induced by z n {t) that will increase by 
one each time when a jump occurs in the w, direction and M l f J is the 
counting process induced by |„(f) that will increase by one each time 
when a jump occurs from state i to state j. The next lemma shows that 
the expectation of B(z n ,£, n ) in the exponent becomes simple in the limit 
n —>► oo. 

Lemma 3.15. 



(3.33) 



(3.34) 



(3.35) 


The proof of Lemma l3.15l is based on the ideas in proving Lemma 5.52 
and Lemma 8.70 in (261 . 

Proof. Since /ift) is a step function and constant in [t m , t m+ \), to prove 
J3.33II , we just need to prove for each m 



(3.36) 


N e (y) := {z £ D rf [0, T]: p { c l) (z,y ) < e}. 


Define 
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We have 

E, 


Xi{Z n {t),Z n (t))- ll\ - . .. - dt 


i T,n 


A 7(y(f)) 


l 

rtm+i 

E Q n X{z n eN e {y)} / A,(z„(fU„(t)) - /i" 

J tm 

r tm+l 

+ E ® n X{z n tN e (y)} / Af(z„(t),f n (f))-/i” 

tm 


A j{z n (t),£ n (t)) 
A 7(y(f)) 


dt 


i A; {Z n {t),£ n (t)) 


dt. (3.37) 


A7(y(f)) 

By Lemma l37l4l the second term on the right hand side of 13.37) tends to 
zero as n —> oo. Next let us estimate the first term. 

By Assumption s .31 we have 


Xi{x’,j) 

A Az,j) 


Xi{x',j) 

Xi(x',j) 


Xiix'yj)- A/(Z,J) 

A7(x) 

A ?(*) 


A?(x) 

A ?(*) 


A ■?(*) 


<A 3 L\\x-z\\ + AL\\x'-z\\ 


(3.38) 


for any z, x,x' e IR rf , i e {1,...,S} and j e {1,2...,£)}. 

Now take an integer AT and divide [f m , t m+ 1 ] into L pieces. Define t/ = 
+ /(f m+ i - t m )/N for / = 0,..., N. Since y is continuous in [0, T], we can 
choose N large enough such that 

sup ||y(f)-y(T/)|| <e for any le {(),••• ,N- 1}. 

fe[T/,T; +1 ] 

By 12.11) and 13.38) . we have 


f*tm+ 1 

X{z n eN e (y)} A i{Z n {t),S n {t))-H 

** tm 


, A/(z„(f),<f„(t)) 






ZV-1 


= A{z„eiV e (y)} 


I / 

Z=0 

L 3"\ 


T Z+1 


A i(y(Tz),L(f))-/t; 


A 7(y(f)) 

iA/(y(T/),|„(r)) 


4 A7(y( T/ )) 


+ Ccd t, 


where C = (2 + 2A + A -5 )!. So we have 

* ^m+1 


lim E ( 

n—'oo 


f 

1 Jt„ 


A i{z n {t),$ n {t))-n T - - . .. - dt 


A 7(y(f)) 

W-l rTi +1 D 

E I E X i {y{ri),j) n 7l {t,j)-iu'- l + Cedt 

1=0 J T l ;=1 

V_1 r T z+i D 

Z I z X i {y{t),j) n 7l {t,j)-iJ , l n + Ciedt 

1=0 j -1 


-J, 


^ra+1 


A7(y(r))-//fdt+Ci(t m +i- f w )e 
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by ergodicity of the process where Ci = (3 + 2A + A 3 )!. Similarly, we 
can also obtain 


lim E, 

n —>oo 


it 

I, 


fm+1 , m A;(z n (fU w (f)) 

Xi{z n {t),$ n {t))- nf - ... . .. - dt 


A 7(y(f)) 


^ fm+1 

- 

fm 


A7(y(f))-ju-"df-Ci(f w+ i - f w )e. 


So we finish the proof for (13.331 ) . 

To prove (13.341) . we first assume that A;(x) are constant functions. In 
[t m , t m+ 1 ), the number of jumps z„ makes in each direction u,l n are in¬ 
dependent Poisson random variables with mean n/i'”(t m+1 - t m ). So 


lim 

n —>-qg 


n v " Jr, 


■/. 


r ' +1 L lo g ^ /(r) 

™ / A*(y(f)) f 

m 


tm+ 1 LI 

X»g ' 

•n i = 1 A, ly(tj) 


df. 


(3.39) 


For general A,, we can use the technique for proving 0.331 1 by dividing 
the interval [t w , f m +i] into small pieces and approximating 0.341) by Rie- 
mann sums. 

For Q.35L again we first assume that qtj{x) are constant functions. In 
[t m ic, t m> jfc+i], the number of jumps makes in each direction e,j are in¬ 
dependent Poisson random variables with mean n-n n (t m ic, i)r] 1 J l ? c {.t m k+i~ 
tmk)- So 


lim t-Ep r mM, E<o S V,,Cn dM‘> 


l <] 

D 


C^m,k+l O D X] 

L L nMi) L< log ^m dt - 


(3.40) 


For general we consider separate cases {z n e AT e (y)} and {z n £ N^ly)} 
as in 0.371) . Similar as proving 0.331 , we can get the limit 0.351 ) . □ 

Lemma 3.16. For given r £ ED rf [0, T] and v £ M^O, T], assume that r is 
absolutely continuous and n v {t, •) is continuous in t. Then for arbitrarily 
small e > 0 we have 

liminf—loglP (z„ £ N e (r),v n £ N e {y)) > - (/ s (r,v) + IAr,v )). 

n — > oo yi \ j j 
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Proof. By Eq. 0.3211 and Jensen’s inequality, for any e > 0 
P [z n e N e {r),v n g iV e (v)) 

>P(z„ e N £ i 2 {y),v n g N d2 {n)) 


E Q>, 


" (.t)) X{z n €.N e /2(.y),v n EN e /2(ji)} 


p B(.Z nt £, n ) _ 

** A{z n eN e /2{y),Vn€.N €/ 2W} 


- E 0;i 1% {zn£N el2 (y) t v n £N el2 {7i)} ] ex P " 


E 0n [^{z„eiV c /2(y),v n eiV e/ 2(;r)}^( z n<£n)] 


E 0 


EN e , 2 (y),v n £N e ,2(Ji) 


}] 


(3.41) 


By Lemmas l3.13l and l3.141 we know that 

I{z„eiV e/ 2(y),v„eiV e /2(7r)} 

Thus, according to Lemma l3Tl5l 0.411 1 and 0.4211 . we have 


= 1. 


liminf—logP {z n e N e [r),v n e N e (y)) 

n—> oo yi 


- li ^ f ^ E QniM^N £l2 (y),v n eN el 2 w}B[z n ,S n )} 

(J -1 rfm+l s 

E / E(A7(y(f))-^) rf? 

m~oJ tm i =l 
/Z, 1 ffm+l S u' n 

+ E/ 

m=oJt m i= i w (yfrj) 


/-I ftm ic+i D U 

E E E %(t.o Ekf'og 

^=0 A:=0 j=l 7 = 1 V 


+ 


D 

E 

7=1 


V 


mk 

ij 


(3.42) 


■ + 




qijiyit )) 

Combining Lemma l3.111 Lemma l3.12l and 0.431 1 , we finish the proof. □ 


dtj. 

(3.43) 


In the final theorem, we remove the continuity assumption on n v {t, •) 
to get the desired lower bound estimation. 

Theorem 3.17. For given r e B rf [0, T] and v e Mh[0, T], assume that r is 
absolutely continuous, we have 

liminf—logP [z n e N e (r),v n e N e {y)) > - [l s {r,v) + //(r,v)). 

Proof. We can construct a sequence of measures v (fc) (Jc > 1) such for 
any k, n v <k) is continuous in t and p (2) (v,v (fc) ) —* 0. From Lemma IA.101 
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I s {r,v) + If(r,v) is lower semi-continuous in v. Thus, we can choose ko 
large enough such that for any 8 > 0 and e > 0, 

I s (rM ko) ) + Ifir,v {ko)) ) > I s (r,v) + If{r,v)-8 

and 

p(2)( v> v (fc°)) < £ /2 

Thanks to Lemma l3.161 we have 

liminf—logP {z n e N e {r),v n e N e (y)) 
n ^oo n 

> liminf-logP (z n e N e {r),v n e N e / 2 (v {ko) )) 

n —*oo fi V 7 

> -f/,(r,v (fco) ) + 7 / (r,v cfco) )j 

> -(/ 5 (r,v) + /y(r,v))-d. 

The proof is completed. □ 

3.3. Goodness of the rate functional. The rate functional I s {r, v) + If(r, v) 
is lower semicontinuous by Lemma lA.101 The goodness of the rate func¬ 
tional is a direct consequence of Lemma l3?7l 

4. Proof of Theorem I2.2I 

Now we prove Theorem f22 } under the consideration r eW = ([R + ) d in¬ 
stead of the whole space. The main clue of the proof is the same as the 
proof of Theorem 12.41 except some technicalities to understand the be¬ 
havior of jumps near the boundary of W. We will only focus on the key 
parts which is different from the proof of Theorem l2.41 

The difficulty in the proof of lower bound is that we can not use the 
change of measure formula directly, since some of the jump rates may 
diminish on the boundary. Mainly following (27], We overcome this issue 
by carefully analyzing the boundary behavior of the dynamics . 

Let a d-dimensional unit vector v := (1,1, • • -, 1 )!\[d and define the 
shifting rg(f) = r(f) + 8v with 8 > 0 a sufficiently small number. With 
similar approach in proving Lemma 5.1 in (27), we can show that 

limsup(7 s (r g ,v) + 7 / (r 5 ,vj) < 7 s (r, v) + 7/(r,v). (4.1) 

5 - 0 + 

Next we will prove 

1 

liminf-logP(z„ g N§{r),v n e N s {v )) > - (l s {r,v) + 7/(r,v)j. 

n —>00 Yl J 
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Denote by V a (r) the modulus of continuity of r with size a, and set 77 (a) = 
max{i4(r),a} so that T]~ l (a) < a. Now, fix 5 and set tg = t]~ 1 {8/3). Then, 
tg <8/3 and for t < £ 5 , 

sup ||r(0) + t- v- r(t)\\ < %• Ml + 77 (f 5 ) < 25/3. 
o<t<% 

Therefore, for 0 < a < 1/6, 

P(z„ £ Ng[r),v n e Ng(v)) > p(||z„(f) - r(0) - t- v\\ < a8 on te [0, tg], 
z n £ Ng[r; [t s , T]);v n e Ng{v) j, 

where Ng{r; [tg, T]) is the 5-neighborhood of r restricted on t e [tg, T], 
Now, on this time interval 


sup ||r(f) - r ts {t)\\ <8/3 

tg-t-T 

and, moreover, d[r ts (t), dG) > tg/Vd. Therefore, for any function uonte 
[tg,T], \\u-r ts \\ < tg /2 \fd implies that || m — r|| < 55/6 and d(r ts {t),dG) > 
tg/2\fd. Now define Ag the ad-neighborhoodofro+fsi', i.e. Ag:= B a g[r 0 + 
tgv) and let r y tg be the shift of r ts such that r y g {tg) = y. Then, 

P(z„ £ Ng{r),v n e Ng{v )) > 

IP(l|z„(f)- r(0)- t- v\\ <a8 on te [0, tg];v n e Ng{v; [0, tg]) ] 

x inf P y z n £ Njg_{r y ;[t 5 ,T]);v n £ Ng{v;[tg,T])). 
y eA s y \ 2Vd J 

The first term satisfies a large deviation lower bound 

liminf—logp(||z„(f) - r(0) - t-v\\ < a8 on te [0, tg];v n e Ng{v; [0, tg])) 
— —Ctg (4.2) 


by estimating the probability of a specific path z n lying in the ad-neighbor- 

hood of the curve r(0) + tv. Because the paths in Njg_{r y ; [tg, T]) are 

2 Vd 

bounded away from the boundary uniformly for y e Ag, by Theorem l3.171 
we have 


liminf—log inf P v 

00 n yeA s 


( 


z n e N t s 

I 2 s/d 


ir y s ;[tg,T]);v n 


eN e {v;[tg,T]) 


-[l [ s t5 ’ T \r t5 ,v) + lf’ T] [r t5 ,v)) 

-(l s {r te ,v) + I f {r ts ,v)), 


(4.3) 
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where I [ s ts,T] {r ts ,v) and I^ s,T \r ts , v) are rate functionals defined on the 
integration interval [tg, T). According to J4.ll) . 1 14.21 ) and 114.31) . we proved 
the lower bound. 

Next let us consider the upper bound. At first we note that since the 
rates A; (z, j ) satisfies the linear growth condition 

Ai{z,j)<Ca + \\z\\), 

it is easy to show that 

lim limsup — log IP ( sup ||z„(f)|| > K) = -oo 

K—>oo n —.oo Tl 0<t<T 

by simple moment estimates and Doob’s martingale inequality. Conse¬ 
quently, it suffices to prove the large deviation estimates for bounded sets 
and we can assume A;(z, j) are bounded. 

We only need to recheck Lemma l3^9l and Lemma lA.lll since the other 
lemmas in upper bound estimates can be verified easily under the as¬ 
sumption that A i{z,j) are bounded. Thanks to Corollary 4.2 and Lemma 
4.6 in 127], we can obtain that Lemma 13791 and Lemma lA.l H are also cor¬ 
rect under Assumption ^. 11 Thus the upper bound is also established. 

The goodness of the rate functional trivially holds under Assumption 
12.11 So we complete the proof of Theorem l2.21 


Appendix 


Lemma A.l. Let {f a } be a collection of lower semi-continuous functions 
on a metric space. Then the function f define by f{x) = sup a f a (x) is lower 
semicontinuous. 


Lemma A.2. Let \f a \ be a collection of convex functions on a metric space. 
Then the function f define by fix) = sup a / a (x) is convex. 

Lemma A.3. LetK{x,y) be a real-valued function, continuous in (x,y) on 
U d x U D , convex in x for each y, and concave in y for each x. Let two 
non-empty closed convex sets U and V be given, at least one of which is 
bounded. Then 

inf sup K{x,y) = sup inf K (x, y). 

xeU y^v yeV xeU 

The proof of Lemma [A3l mav be referred to Corollary 37.3.2 of [24]. 


A.l. Part 1. Proof of lemmas related to the upper bound estimate. 


Lemma A.4. Let z it) e W 1 be any measurable process for t e [0, T], Sup¬ 
pose there exist numbers a and S such that for each peU d with \\p\\ = 1, 


sup (z{t),p) > a | < 8. 

\0<t<T 
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Then 


sup ||z(f)|| > a\fd 

Vo<f<r 


<2 dS. 


Proof. It is not difficult to find that 



where p, := e;, p i+d := -e, for i = l,...,d, and are chosen as the canon¬ 
ical orthonormal basis in Euclidean space [R rf . □ 

In later texts, we will take an abused notation £„(f) = e, e IR D when 
£ n (t) = i e Z D . This will not bring confusion since £„(t) is considered as 
a multidimensional vector only when we take inner product with other 
vectors. 

Lemma A.5. There exists a function K : IR + —» IR + with 

lim K{a)la = +oo, 

a-^oo 


such that 


sup II z n (t) 

\0<t<T 


Zb (0)|| 


a \< 2dexp^-nTK^— jj. (4.4) 


Proof The inequality (14.41) holds trivially whenever K(al T) = 0. It suffice 
to prove the lemma when a is large. For p e U d , a e IR D and any p > 0, 
with the form of infinitesimal generator 5£ n 11.21 1 , we define a mean one 
exponential martingale 


Mj =exp [ (z n (f) - z n (P),pp) - n f A i (z n (s),S n {s)){e( pp,Ui/n '> -l)ds 
\ Jo i= i 

r-t D D \ 

+ (£w(f) - £rc(0),<r> - n I ^Ig„c S )=i} X dij(z n {s)){e {a ’ ei i } -l)ds . 

J 0 /=i i=i / 

Define U = max!<j< s || w;||. Fix \\p\\ = 1, we have 

n [ Y j A, i (Zn(s),Zn(s))(e < ' pp ’ Uiln ' / -l)ds< ntSAe Up,n =: R{t,p) 

Jo i=1 
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by Assumption s .31 Hence we obtain 


sup (z n {t)-z n [0),p) > a 

\0<t<T 


sup exp(p (z n (f) - z n {0),p)) > exp(pa) 

\0<t<T 


sup Mj 7 0 > exp ipa-R(T,p)) 

\Ki<t<T V 7 

exp (nT SAe upln -~ ), 


where the inequality follows from Doob’s martingale inequality. Take 

n, a 

p = — log-> 0. 

r U 6 TSAU 

Then it is not difficult to show that if we set 

a 


K(a) = — (log ——-l] 

II l 3 S/\U ) 


ijy sau 

for a large and K{a) = 0 otherwise, then 


sup (z n (t)-z n (0),p) > n) < exp . 


\0<t<T 


Define K{a) = K{al \fd), we get the desired estimate by applying Lemma 

lA~4l □ 


Corollary A.6. There exist positive constants C\ and c 2 independent of t 
and r, such that for any t, r £ [0, T] with 0 < t + r < T, 

p( sup \\z n {s)-z n {t)\\ > fl) <2dexp(-nacilog(—)). 

' t<S<t+T ' ' ' T ' ' 

Proof of Lemma l37Tl Consider a typical interval [tj, t” +1 ]. Since z„(r) and 
z n {t) agree at the endpoints of this interval, it is obvious that 

& & 

\\z„(tp - z„(t? +1 )\\ > - implies \\z n {tj +l ) -z n {tp\\ > 

On the other hand, we have 

— Z n {tJ) || > \\z n (t) — Z n (t) || — \\Z n (tJ + f) — Zn{tJ) || 

since z n is piecewise linear and z n {tp = z n {tj). Therefore if || z n {t) - 
z n [t ) II > 8 for some t in the ;th interval, we must have 

sup \\z n (t)-z n {t’f\\ >8/2. 
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Applying Corollary lA.6l with a = 812 and r = Tin we obtain 


sup ||z„(t)-z„(f”)|| ><S/2 


V 7 7+ 1 


2d exp -n^logj-^^)], 


where c 3 = c 2 IT. Thus, 


n -1 

P(p (1) (z„,z w ) ><?)<£> 
7=0 


sup 


I|z, 2 (t)-Z„(t)|| 


>b 

> 


72—1 

^E» 

7=0 


sup 

V f ,"-^7 +1 


l^n(f) 


Z„ (r") II >5/2 

; 


< 


n- 2d exp 


bCi 


-n- 



The result follows since C\ and c 3 are positive constants. □ 

Lemma A.7. For any given bounded sets Ai e IR rf and A 2 £ U D , we have 
that 


limsupE tm exp 

n—> oo 



\ r T,n s 

z n {0),p)-n H° [x,p,n Vn {t,-))dt 


+ 



\ rT In 

^„(0 ),a) + n J S s (x,n Vn (t,-lo-)dt 


< 1. 


holds uniformly in x e IR rf , m e {1,2, • • •, D}, p £ A\ and a e A 2 , where E x , m 
means the expectation with respect to the paths of {z n ,£, n ) starting from 
(x, m) att- 0. 

Proof For any p e A\ and a e A 2 , define the mean one exponential mar¬ 
tingale 


M f = exp n 


+ 


rt O 

(■Z« (t) — ■Z;;(0), p) — I E ^ i(Zn{s),£n 
Jo i=1 

rt D D 

<£«(fW«(0),O->-n / El{fnU)=il E dti^n 

Jo j=i /=1 


(s))(e< p ' Mi >-l)ds 
(slXe^’^-l)ds| 
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Since z n [tp - z n (tp, for any peAiwe have 


1 =E* )W exp \n 



n 


- \-z n (0),p 


+ 


n 1 / n o u 

/ L L - l)v n {ds,j) 

Jo j=ij=i 

/ /Ti \ r r/ ” D / \ 

uJ — J-€n(0),(r)-nj J2 cjjj(z n (s))(e' cr ’ ei j' — 

^ i i /"—1 


l)v„(ds, i) L 


By definition, the term 

S D 

Y H hiten(s), j){e < ' p,Ui ^ - 1 )v n {ds,j) 
i=lj=l 

can be written as H s {z n ( s),p, n Vn ( s,-))ds and 

D D 

~YH qij(z n (s))(e {a ’ ei B - l)v„(ds,z) 
*=1J=1 

can be written as S(z„(s), n Vn (s, • ),a)ds. 

Let 

S 5 = {w: sup ||z n (f)-x|| <-[, 

l 0<t<Tln 2 I 


we have 


1 > ^x,mXs s exp ■ 



n{ Zr 


+ ( 


-\-z n { 0) 
\n) 

Tin 


\ r TIU 

,p)-nj H s [x,p,n Vn {t, 



Ex, m exp 


+ (f 


-£ W (O), 0 -^ + n J S s (x, n Vn {t,-),a)dt 

\ C Tln 

>P)-nJ [x,p, n Vn {t, 


— | - z„(0), 




S 6 {x, n Vn {t,-),(j)dt 


\ rTi n 
>p)-nj H s s [x,p,n Vn {t, 


■Ex,mis? exp 


+ ( 



' T\ \ rT/n i 

—J -% n {0),aj + nj S s {x, n Vn {t,-),cr)dt> (4.5) 

Since A\ and A 2 are bounded sets, there exist B\ and B 2 such that || p\\ < 

Bi and ||<r|| < B 2 . From the Assumption 12.31 and the boundedness of p 
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and a, we have 


E x,mXs c x exp 


+ u 


1 

f /. 

(T\ 


n(z n 

— 

l 

{ \ 

[n] 


\ rTIn 

,p)-nj H d (x,p,n Vn (t,-))dt 


' T\ \ rTIn 

— I -£ n (0),oy + n J S 5 {z n {t), n Vn {t,-),cr)dt 


<E*,, 


Xs c 5 ex P 


n { z 


^\-z n {0),p ) + 3 K 


OO 


^ E ex P 

k= 1 
oo 

^ E 2 ^ ex p 

A;=l 


n(/c+ l)-|p| + 3i<C| x 

i 2 


' k5 (fc+l)<5 

— =£ sup |z„(f)-x|^--- 

i 2 O^t^TIn 2 


n 


v 2 2 


Mci , 
log 


M|2]||xe«-o 


(4.6) 


as n goes to infinity for all x eU d with \\p\\ < B\ and Hall < B 2 , where K 
is a uniform bound depending on the bounds ofS 5 (-,v) and H d (•,■,•) in 
the whole space, B\, B 2 and T. Combining <14.611 and <14.511 . we complete 
the proof. □ 

Corollary A.8. For any fixed step functions 6 (f) e U d and a ( t) e U D , there 
exist constants C > 0 and n 0 such that 


Eexp {nj n (z n ,0,v n ,a)} < C 

for all n > n 0 , where J n is defined in H3.9I I. 

Proof By definition 


exp {nj n {z n ,0,v n ,a)} 
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= exp I Y [n(zn{tj +1 )-z n {tp,0{tj) 

nt? +1 

-n I J [z n (f ”), 6 ( tj), n v „ (r, •)) dt 

t j 

+ (<wz(?” + i)-£nU”), a(f")) + nj ; J S s (z n (tj),n Vn {t ,•), a{f-))dt 


n -1 


7=0 




(4.7) 


Now a is a step function, let us first consider a(f) = a 0 on the interval 
f e [0 ,t]. We have 


72— 1 


7=0 


= U„ 


L»tJ 

n 


Y T{f" +1 <r} \£rc(f/+i) <*0 


7+t ; 


^n(O), a 0 


where La. 
in [0,T], 


L" = o \<wU”+i)-6zUp,a(f")/ is bounded. Thus by 03 , 


is the largest integer smaller than a. Since <; n and a are bounded 
($„ - £„(0), «o^) is uniformly bounded. Repeating this 

argument on the finite number of intervals on which a are constants, 
we have that 

Lemma lA?7l and the Markov property of (z n , 

limsupEexp {nj n (z n ,0,v n ,a)} < C 

n—> oo 

where C is a positive constant. 

Lemma A.9. (Uniformly absolute continuity) Given r e D> rf [0, T] and v e 
IVDiLO, T]. Letl s {r,v) + If{r,v) < K and fix some e > 0. Then there is a 8 > 0, 
independent of r, such that for any collection of non-overlapping intervals 
in [0, T] with total length 8 

{[tj, sf, j = !,•••,/} with J^iSj<-tj) = 8, 


□ 


7 = 1 


we have 


Y \\r{Sj)-r{tj)\\ < e. 

7 = 1 

We can also find a constant B depending only on e and K so that 

•T 

X{\\r{t)\\>B}dt < e. 


f 

JO 
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Proof. For any collection of non-overlapping intervals {[tj,Sj]\j, define 
the function k{t) to be equal to one if t is in some interval [tj, Sj] and zero 
otherwise. Since I s {r,v ) + If{r,v) < K, r is absolutely continuous and 
I s {r,v) <K. For any a >0, 


Y I \r{Sj)-r{tj) 
7=1 


f \\r{t)\\k{t)dt 
Jo 

f a ' X{\\r(t)\\<a}k(t)dt 

Jo 

+ f 


< a-8 + 


L s (r(t),r{t),n v (t, •)) 
L s {r(t),r(t),n v (t,-))/\r{t)\ 
K 


X{\\r{t)\\>a}k{t)dt 


/(«) 


where 


/(a) := inf \ 

z,p,we\ D [ 


L s {z,p,w) 

11/611 


: 11/611 >a . 


Recalling the definition of L s {z,(5, w ) in (12.61) . we define U := max, ||m, ||. 
For any we A D if we take p = /Jlog||/S||/(f/||/i||) in ( 12.61) . we obtain 

L s [z,p, w) > || p ||log||/61|/[7-H/6||SA. 

This means that f{a ) -*■ oo as a — oo. The choice a = H\/~8 and taking 8 
sufficiently small establishes the uniformly absolute continuity. 

Now we turn to the second statement. Since 


f 

Jo 


X{\\rlt)\\>B}dt < 


H llnota > 

BJ o 


r(t)\\>B}dt 

L s (r{t),r(t),n v (t,-)) 


L s (r(t),r(t),n v (t,-))/\\r{t)\\ 


X{\\rlt)\\>B}dt 


-'sv' yi'jy * yi'j} ii'vx 

1 I s (r,v) 


B /(B) ’ 

we complete the proof by choosing a sufficiently large B. □ 

LemmaA.10. The rate functionals are lower semicontinuous, i.e., if{r u , v n ) 
(r,v) asn — oo, then 

liminf7 s (r„,v„) > I s {r,v), liminf I f {r n ,v n )>I f {r,v), (4.8) 


liminf if (r„,v„) >/f (r,v), liminf I s f {r n ,v n )>I s f {r,v) (4.9) 


7 V 


and 


liminf/f(r„,v„,0) > I s s [r,v,Q), liminf Idr n ,v n ,a) > I s Ar,v,a) (4.10) 

V) —»-rsn n — J J 


ft—► OO 

for any fix step functions 6 (t) e and a(t) e R D . 
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Proof. We only need to consider the sequences of r n which are abso¬ 
lutely continuous since it will be trivial otherwise. Let (r„, v n ) —» (r, v) as 
n -» oo. We may assume that I s {r n ,v n ) + If{r n ,v n ) is bounded, say by a 
constant iL. By Lemma lATll we know that r is also absolutely continuous. 

Since r(f) is absolutely continuous in [0, T], given 8, we can partition 
the interval [0, T] into / intervals 0 = t\ < ?2 < • • • < f/+i = T each of length 
A such that 

max sup \\r n (t)-r n (tj)\\<8. 

i tj<t<t j+ 1 

Denote F n {t, i) = v„([0, f ], i) and F[t, i ) = v([0, f], i). Recalling the defini¬ 
tion of L s s (z, /3, it/) in 13,51 . we have that if (z, /J, it/)) is lower semicontinu- 
ous in 8, z, p and w and convex in and w by Lemmas lAlTl and lAl2l Thus 
for any e > 0 and small enough A, we have 


f 

Jo 


L s {r n {t),r n {t),n Vn {t,-))dt 


J ftj +1 


Lf 

./=! Jt i 


L s s {r n (tj),r n {t),n Vn {t,-))dt 


>^A -LUrMj), 


fl J+1 r n {t)dt fl J+1 n Vu {t,-)dt 


j =i 


dt 


/ 


V" a rS( r n(tj+ 1) r n(tj) F n {tj+\,-) F n (tj,-) 

u A ’ A 


(4.11) 


Define the functions rj, Fj as 


rj{t) = r[tj), Fj{t,-) = F{tj,-) for tj < t < tj+i,j = l,---,/ 

and let 


r 7 (t) := r 7 (f + A), F J {t,-) := Fj(t + A,-) forO<t<T-A. 

By 14.1111 . we have 

liminf f L s {r„[t),r„{t),n Vn {t,-))dt 

ii *oo Jo 

rn(tj+ 1) — f F n ( tj +], •) — F n ( tj , •) 


/ rtj+i 

Y / limi 

. . /* 72—*C 

/- 1 rtj 

hi, 

l. 


liminf I 1 : 


r n itj),- 


J ~ l rt J +1 rS ( r J [t)-rj{t ) F J {t,-)-Fj(t ,-) 




r-A 


^k/(f)> 


A A 

rkD-r/p) F J {t,-)-Fj{t,-) 
A ’ A 


df 


df. 
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Now we use the nested partitions Jk = 2 k , so that = T / 2 k and a corre¬ 
sponding sequence 8 k that converges to zero. By Fatou’s Lemma, 


T- A* 


liminf f 

k^oo Jo 

f liminf 

JO fC^OO 

f 


5 k 


r hW’ 


r lk {t)-r Jk {t,-) F Jk {t, -)-F ]k {t, •) 


dt 


s k 


t<T-A k }L s 


r hW’ 


A A 

r J Ht) -r Jk {tr) F Jk {t r ) - F Jk {t,-) 
A ’ A 


dt 


L s (r{t),Ht),n v (t,-))dt. 


So we established the lower semicontinuity of I s {r, v). 

The lower semicontinuity of If{r,v ) can be done similarly. Recall the 
definition of S s {z, w) in (13.181 1. we have that S s (z, w) is lower semicontin- 
uous in 8, z and w and convex in w by Lemmas lA.l l and [A.2l With exactly 
similar procedure as proving the lower semicontinuity of I s [r, v), we can 
establish 


liminf f 

n^oo J 0 


liminf S(r n (t),n v (t,-))dt > 


l 


T-A ( 

s 8 


T }{t), 


F J {t,-)-Fj{t,-) 


dt 


v A 

for a fine enough partition. Again we consider the sequence of nested 
partition Jk = 2 k and A k = TI2 k . By Fatou’s Lemma and the lower semi¬ 
continuity of S, 


liminf f 

fc—>oo Jo 

f liminfj{ 

JO A:—»-oo 

f 


: s k 




F Jk {t,-)-Fj k {t,-) 


dt 


t<T-A k }‘ 


?8k 




F jk (t,-)-Fj k (t,-y 


A 


dt 


S{r{t),n v (t,-))dt. 


Thus we obtain the lower semicontinuity of //(r,v). The proof of H4.9H 
and H4.10I) are simlar. □ 


Lemma A. 11. Given r e B rf [0, T], veMifO, I] ande> 0, there exist step 


functions 6 (f) £ R d and a{t) £ R D such that 

l s {r,v,0) > I s (r,v)-e, 

(4.12) 

I 8 {r,v,d) > /f (r,v) -e, 

(4.13) 

and 

I f {r,v,a ) > If(r,v) -e, 

(4.14) 

If{r,v, a) > I 8 (r,v) - e. 

(4.15) 
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The proof of (14.1211 and (14.131 1 can be referred to Lemma 5.43 in (26] and 
the proof of ( 14.141 ) and ( 14.151 1 is similar. We will outline the main proce¬ 
dure here. 


Proof. If r is not absolutely continuous, If(r,v, a) = oo by definition, so 
nothing needs to be proved. Now let us consider the case that r is abso¬ 
lutely continuous. For convenience, let L s (z, jS, w,p):= (p, P)-H s [z,p, w) 
Since by definition L s {z,p, w,p) < L s {z,p, w) for any p, we have for B 
large enough 


< 


< 



X{\\rm>B}L s {r[t), r[t), n v [t, -),0{t))dt 




by Lemma lA.9l Choose 0\{t) = 0 whenever ||r(t)|| > B or r(f) is noting 
as defined in (12.12t . Let R := sup 0 < f < r ||r(f)||. Since r is continuous, R is 
finite. Simply replacing A, by T.f = i Aj(z,j) Wj in Lemma 5.23 of [26], we 
have for B\ large enough, 

e 

sup L s {z,p, w,p) > L s (z,p, w) - — 

\p\<Bi o 1 

for all ||z|| < R, || jS|| < B in^ and w in A^. So for any (z,/J, w) in bounded 
set 

A:= {\\z\\ < R, p e^,\\p\\ < B,w e \ D }, 
there exist a p z p w with || p z p w II < Bi such that 

e 

L s (z,p,w,p z p w )>L s (z,p, 

On the bounded set 

{II z|| <R,pe \\P\\ < B,w e A D , \\p\\ < B,}, 

the function L s (z, p, w, p) is uniformly continuous. What’s more, by Lem¬ 
mas 5.22 and 5.33 in (26), L s (z,p, w) is continuous in A. So given any 
(z, p, w) e A, there exist a 8 z p w > 0 such that 

e 

L s (z,p, w,p z pj > L s [z,p, w) - — 

holds for any ( z,p,) e O z p w n A, where O z p w is the 8 z p w -neighborhood 
of (z, p, w). By Heine-Borel theorem, we can choose finite number of 
O z ipj w k to cover A. It means that 

L s (z, p, w, p z ipj w k ) > L s (z, p,w)-^~ 
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whenever ||z-z ! || + \\p-p j \\ + || w-w k \\< 8 zip j wk . 

Define the function Q\ (r) = p z ipj w k whenever \\r(t)-z l \\ + 1| r(f) - pi || + 

|| n v {t, •) - w k || < 8 z ipj w k with some tie-breaking rule. The function 0i(f) 
takes finite number of values. It may not be constant on intervals of time. 
So we approximate 6\{t) by a step function. Choose T] small enough such 


that 


f 

Jo 


X{teA}Lsir{t), r(f), n v (t, ■))dt < c/4 


whenever the set A has measure less than r). Since Q \(/) is a simple func¬ 
tion, we can approximate it by a step function 6 and it agrees with 61 
outside of a set of measure T] (c.f. [25]). We finish the proof for 114.121) by 
collecting all approximations above. 

For the proof for J4.14I) . we take advantage of Lemma 5.23 in (26] again 
byreplacing A; with T.f = i Witfij- We have for C large enough 


e 

sup S(z, W,(T ) > S(z, w) - —. 
l|o-||<C 


On the bounded set 


{\\(t\\<C,\\z\\<R,weA d }, 

the function S(z, w, a) is uniformly continuous. With the similar strategy 
for L s we can find the desired step function a. So we finish the proof for 
( 14.141) . The proof for if and 1^ are similar. □ 

A.2. Part 2. Proof of lemmas related to the lower bound estimate. 

Proof of Lemma l3TIIl Since S(z, w) is bounded by Q := Lf ;=1 sup * 7,7 (z), 

there exists (rj(s),i/r(s)) £ for any s e [t,„, £„, +1 ] such that 

£ £ / , ( 5 ) 1 
L y/i is) 2^ 1 17,7 (s) log + <?// (y(s)) -Vij («) 

i=i j=i Ljijyyv^)) 

<S(y(s),n v (v)) + e 

and 

|t/r,(s) - n v (s, i)| < e/(8DT) 

by Lemma 8.61 in (26). For each fixed s £ f m+ i], there exists 8 S > 0 
such that 

D D . TJ'' (s') \ 

Lviis) £ (17,7 wiog qi ‘ J iy{s)) + 

<S{y(t),n v {t,-)) + 2e 


and 


\y/i{s)-n v [t,i)\ <e!{ADT) 
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hold for any teO s = ( s-6 s ,s + 8 s ) n [t m , t m+ i]. By Heine-Borel theorem, 
we can choose finite number of 0 Sk in {O s } se[tm>tm+l] to cover [t m , t m+1 ]. 
It means that there exists a further subdivision of interval [t m , t m+ \] (i.e., 
t m = t m0 < t m i < < t mKjn = t m+ 1 ) and related iy/ m is k ),q m is k )) e Sf such 

that for all t e [t m]c , t mik+1 ] 

d d qfis k ) 

E [riTj^k) log +qijiy(t))-T]f j {s k )) 

i= i j =i mjy.yvi')) 

< S(y(r),n v (r,-)) + 2e. 

Since log^y(z) are bounded and Lipschitz continuous in z, we can es¬ 
tablish that S{z, w) is absolutely continuous in z, and this absolute con¬ 
tinuity is uniform in w e At> To see this, we only need to show that the 
function 

' D 

fix,w):= sup - Y, w i x ij - 1 

creIR- 0 i,j= 1 ' 

is absolutely continuous in x = (xn,xi 2 ,...,xdd) e [1/A,A] d2 (as defined 
in J2.11H . uniformly in w e Aj> For any x,x+Ax £ [1/A, A] D with || Ax|| < 
1/4A, let h = 1/4A, r = ||Ax||/(fi + ||Ax||) and define q = X+ A x/r. With 
this construction, we have q £ [1/2A,M+ 1/2A] D , /(x, w), f[x + Ax, w), 
f{q, w) £ [0, (A+ 1/2A)D 2 ] andx +Ax = (1 - r)x+ rq. From the convexity 
of f{x, w) in x, we have 


fix + Ax, w) < (1 - r)/(x, w) + rfiq, w) 


and thus 

fix + Ax, w)- fix, w) < rifiq, w)- fix, w)) < 4A^A +^-jD 2 ||Ax||. 

The absolute continuity in z and uniformity in w of S(z, w) ensures that 
the estimate 

S(y(f),n v (f,-)) < Sirit),n v it,-)) + e 
holds when / is large enough. 

To simplify the notation, we will rewrite q m is k ) as q mk and y/ m is k ) as 
y/ mk . So for each m, we have 


*fY' W ? ml E i mi, „ mi). 

E J LvT t Z(v'^ioB—— + q l jmtn-v^)dt 

fc=o Jt mk i =i j=i qi]Vyv L )) 


L 


tm+1 


Sirit),n v it,-))dt + 3it m+ i - t m )e. 


The proof is completed. 


□ 







Proof of Lemma l3. 121 Define 

S , D [If \ 

/(/i,A(z, •),«;):= Y Y Ai (z, j) Wj- Hi + Bi log —5—- 7 —-— 

1 = 1 V 7 = l Lj =l Ai(Z,j)Wj l 

and 

L s (z,p,w)= inf /(/i,A(z, •),«')• 

Taking advantage of Theorem 5.26 of [26], we have 

L s {z,p,w) = L s (z,p,w). (4.16) 

We will show that for any B\, L s {z,p, w) is continuous in z and w, uni¬ 
formly in p in 

7:={pe^,\\p\\ <£i}, 

where *£ is the cone defined in (12.121 1. 

By Lemma 5.20 of (26], we can find a constant £2 such that for any 
p e T there exists a h e ^p with || h\\ < B 2 . Therefore, for all p e Y and any 
H £ 'Xp with ||)u|| <B 2 , 

L s {z',p, w')-L s {z,p, w ) 

</(/i, Hz', •), w') - L s {z, p, w) 

</(/i, Hz, •), w') - L s {z,p, w) + Ci \\z' - z\\ 

</(/i, Hz, •), w) - L s {z, p, w) + Ci \\z' - z\\ + C 2 II w'-w\\ 

for some positive constants Ci and C 2 . Now choose h to minimize L s {z, p, w) 
to establish that 


L s (z',p, w') - L s (z,p, w) < Ci Hz' - z|| + C 2 1| w' - w\\. (4.17) 

By Lemma 5.17 and Lemma 5.32 of (26) (replacing A / (jc) with£^ =1 A i{x,j) Wj), 
we know that there exist positive constants M\, M 2 and B so that for all 
P g ^ with \\p\\ > B , all z e IR rf and all w e /S. D , 

Mi || p || log || p || < l s (z, p, u/) < M 2 1| p || log || p ||. 


So for any q e IED d [0, T] and any v £ Ml [0, T], 

■T 

X{\\rm>B}L s {q{t), r(f), nv(f,-))df 


/ 

: [ I{||r(f)||>B}M 2 ||r(t)|| logll r(f)||df 
Jo 




Mo 
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By Lemma lAAR we have e{B) —» 0 as B -*■ oo. Combining <14.171 1 and (14.181) . 
we have for any e > 0, there exist a 8 > 0 such that 


sup \\q{t) - r(t)|| < 8 and sup \\riyit,-) - n v (t, Oil < 8 

0<t<T 0<t<T 


implies 
*r 


f 

Jo 


L s {r{t),r{t),n v {t,-))dt- / L s {q{t),r{t),riy{t,-))dt 

Jo 


< e. (4.19) 


With this continuity property, we have 

• r _ 

L s (r(t),r(t),n v (t,-))dt 


/ 


J t rt m +1 


7-i c 

E f 

m=0 ,J tm 
J— 1 r^m+1 

E f 

772=0 J tm 

'v= A T ( \ r{t m +l) ~ rit m ) 

— 2—! 7 • Mjiitm, •) j — C. 


L s {r(t),r{t),n v {t,-))dt 

L s [r{t m ),r[t),n n [t m ,-))dt-e 


772=0 


By definition of L s , for each m, we have j \i m e Kp m such that 


r{t m ), 


r{t m +i)-r{t m ) 


i ^71 ( 1 / 7/1 - ) 

B? 


7 = 1 

and finally we have 
• r 


E^wui-TC^riog-^l-./r 


l 


L s (r(t),r(t),n v (t,-Bdt 
7 -i s 


E V E(*? wo>-7*r+*‘" 1 °8 x»tikj) )“ 2e 


772 = 0 2 = 1 

• r s 


rl z , Li r " s 

> y A^(y(t))-p" ! + p'”log—E- )df-3e. 

Jo A7(y(f))J 

Lemma l3.12l is proved by combing (14. 1 61) and H4.20I) . 


(4.20) 

□ 


Proof ofLemma l3.131 We need to prove that for any bounded continuous 
function h{t, z), 


lim T 

n^ooj o 


h{t,$ n (t))dt 


pT D 

= / 

Jo /= i 


i)n n [t, i)dt 
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in probability. It suffices to prove that for each time interval [t mk , fm.fc+iL 

D 


r tm,k+l 

lim 

n ^°°Jt mk 


h{t,$ n {t))dt 


Ptm,k +1 

= I Yh{t,i)n 7l {t,i)dt. 

^ tmk i =1 


Since £, n lives on only finite states, then for any e > 0, there exists 8 > 0 
such that for 1 t k - t \ < 8 

\h{t,l n {t))-h{t k ,l n {t))\ <e, 

for all re [t mk , 

tm,k+ ll- 

Take an integer L large enough and define 8 = {t m>k+ 1 - t mk )IL < 8. Let 
r; = t m k + 18 for Z = 0,1,...,L. We have 


f* tm,k +1 

lim sup / 

n—>OQ Jtmlr 


h{t,^ n {t))dt 

' tmk 
N~ 1 PTi +1 

dim sup Y I h{t,Z n (t))dt 
n—>o o 7_n Jti 


1=0 
N ~ l r T i+i 


JV-I /»T Z+1 

< lim sup £ I h{ri,^ n {t))dt+ Te 

n^oo i= o Jt; 

N-l r^l+i D 

= Y / Y h ^i>^ n ^ t >^ dt+Te 

k=0 ’* T l 7=1 
N-l fU+i D 

<Y / X i)dt + 2Te 

]c-qJti i-l 
r^m,k +1 

= Y k(t,i)n„(t,i)dt + 2Te. 

Jtmk 7 = 1 


(4.21) 


In 1 14.21ft we utilized the ergodicity of the process on each interval [t/, t/ +1 ). 
The convergence can be obtained in the almost sure and Lp -sense rather 
than in probability (6). Similarly, we can prove 

f‘ k _ r tm,k+l D 

lim inf I h{t,£ n {t))dt > I Y hit, i)n„{t, i)dt-2Te. 

40 Jt mk 7=1 

The proof is completed. □ 

Proof of Lemma l3.14l The goal is to prove that for any e > 0, 


lim I 

72—>CO 


sup ||z„(f)-y(f)|| >e| =0. 

\0<t<T 
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For any peU d and p > 0, we have the martingale 
Mf = exp | (z n (f) - y{t), pp) 

- [‘ £ [np (f) jlgnWjnW) (e <pp.»,/n) _ 1} 

Jo A7(y(s)) 

= exp | (z„ (f) - y(f),pp) 


-/ E(w 

Jo , = 1 V 


(5)- 


A 7(y(s)) 


(pP’Ui) 


+m.M -1) - (pp. ».»)ds 

Recall the Assumption l2.3l and pdt) is piecewise constant and bounded, 
we can perform similar estimate as in Lemma lATsH o obtain 


sup 

\0<t<T 


rt $ 

ZnCt)-y(t)- E Ah 
Jo /=1 

exp^- ncci log(ec 2 )j, 


f s A ; -(z«( 5),|„(5)) - A7(y(s)) 

(^)- ^ -ASM; 


A7(y(s)) 


5f J 

(4.22) 


where C\ and c 2 are positive constants. By Lemma l3TT3l we have 

[ Ai{z n {s),Z n {s))ds- f A?(y(s))ds 
Jo Jo 

= |J A i(z„(s),f„(s))ds-J Ady(s),£ n (<>))dsj 

+ fz Aj(y(s)> j)tty n ( 5 , j)ds A ( . (y(-d)d.sj 

^ k[ \\z n (s) - y{s)\\ds + B n , 

Jo 


where 


B n = sup 

fe[0,T] 


z/ o ' Ady(s), j)(nv„(s,;)- n„(s,;)jds 


(4.23) 


(4.24) 


as n goes to infinity for t<T. 
Define C = dAUT A, where 


A= max max p,(f) and U = max ||m,|I- 

fe[0,T] /=!,...,S /=!,--■ ,S 
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Combining (14.2211 , (14.2311 and <12.111 1 , we have 

sup [\\z n (t)-y(t)\\-CK [ |z„(s)-y(s)||ds-CB„) 
o<t<r v Jo ’ 

■ t s 


> e 


sup 

\0<t<T 


rt S 

z„(f)-y(f)- Y.Vi 

I Jo i= i 

< exp ^ - nec\ log(cc 2 ) j. 

From (14.2511 and Gronwall’s inequality, we obtain 


Ai(z n (sU n (s))-A*(y(s)) 

(f)-—- asui 

A 7(y(s)) 


> e 


(4.25) 


sup ||z„(f)-y(f)|| 2= (e + C5„)e 
Vo^f^r 


CKT 


- y(f)ll - ck | 

Jo 

exp(- neci log(ec 2 )j. 


sup |||z„(f) 

Vo^f^r 


Zn(5)-y(5)||ds 


Combing the condition <14.241 1 and the inequality 


sup ||z„(t)-y(f)|| ^2ce 

vo=sf«r 


CKT 


V0=Sf=sr 

we finish the proof. 


sup ||z n (f) - y(f) II £ (c + CB„)e c ^ r ] + P (fl* ^ 1), 

l X C ) 


□ 
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